← All datasets

Metagenomics

EMG produced TPA metagenomics assembly of PRJNA728374 data set (Gut microbiome responses to dietary intervention with hypocholesterolemic vegetable oils.).

Gut microbiome sequencing from a dietary intervention study involving cholesterol-lowering vegetable oils, reassembled by MGnify. The benchmark uses InterPro functional-abundance profiles of microbial communities to predict recorded host sex.

Binary classificationLicence: PublicMGYS00006282Target: host sexmgnify ↗

Mean cross-validation scores for this dataset. Each score comes from the requested feature- and sample-cap cell, and failed fits use the constant predictor.

At this operating point

Model comparison

p=10,000, n=100 · Higher Macro-F1 is better

Random Forest is marked with a diamond. Models are ordered by the selected metric.

Across sample budgets

Learning curves

All metric values at this operating point
ModelMacro-F1MCCBalanced accuracyROC-AUC
TabFM0.60570.240.61380.6238
Logistic Regression0.60030.21740.60630.5889
RealTabPFN 2.50.59720.21630.60580.5914
TabPFN 30.59520.20960.60180.5937
AutoGluon0.58910.22390.6040.5782
TabDPT †0.57710.16930.58290.5851
TabPFN Wide 5k (ne3) ‡0.55430.150.56630.6001
CatBoost0.54220.096960.54720.5151
RealMLP0.53930.16510.57150.6224
MLP0.53880.089750.54370.5527
Extra Trees0.53370.081990.53890.5358
MITRA0.53340.084740.54110.5286
RealTabPFN v20.53090.078760.53880.5429
TabM0.52450.066970.53220.5315
KNN0.52310.053520.52660.5286
XGBoost0.51430.038660.51830.5151
LightGBM0.50520.023050.51140.5152
Random Forest0.5040.037020.51630.521
TabPFN Wide (8k) ‡0.4629-0.0072140.49690.5543
TabICL v20.335100.50.5